Searching PAJ 



1/2 s<—i> 



PATENT ABSTRACTS OF JAPAN 



(1 1 publication number : 09-069053 
(43)Date of publication of application : 11.03.1997 



(SDlntCL 



G06F 9/46 



(21) Application number : 07-224100 

(22) Date of filing: 31.08.1995 



(71) Applicant : TOSHIBA CORP 

(72) Inventor : MAEHARA KAZUO 



(54) MULT7THREAD CONTROL SYSTEM AND QUEUING SYSTEM OF MESSAGE RECEIVING 
MECHANISM 

(57)Abstract 

PROBLEM TO BE SOLVED: To improve the system 
throughput and processing performance by varying and 
controlling the number of respective threads that 
receive and process messages. 

SOLUTION: The number of message receiving threads 
(MRS) 111,1 1 2_ of the message receiving thread 
mechanism 11 is varied and controlled under the control 
of a thread queue Managing mechanism (SAQM) 1 4. 
Further, the number of queues put at the free queue 
(FQ) of a message queue 12 is varied and controlled 
under the control of a thread queue managing 
mechanism (SAQM) 14. Furthermore, the number of 
message processing threads (PES) 131. 132... is varied 
and controlled under the control of the thread queue 
managing mechanism (SAQM) 14^ Namely, the respective 
threads 1 1 and 13 and queue 12 are varied and 
controlled under the control of the thread queue 
managing mechanism (SAQM) 14 according to a load 
state and the respective threads 1 1 and 1 3 and queue 

12 are controlled to proper numbers within predetermined ranges respectively 
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[COMPUTER TRANSLATION FROM JAPANESE PATENT OFFICE WEB SITE] 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the multithread control system and 
queuing method of a message receiving device which perform processing which carried 
out the queuing of the processing demand message which received through the 
communication line, took out the message by which the queuing was carried out, and was 
demanded. 
[0002] 

[Description of the Prior Art] In the message receiving device in which processing which 
carried out the queuing of the processing demand message which received through the 
communication line conventionally, took out the message by which the queuing was 
carried out, and was demanded is performed, reception of a message and processing 
according to the demand of a message which carried out the queuing were performed by 
one thread, respectively. 

[0003] Therefore, in the former, when the load was applied, there was a problem that a 
throughput will fall extremely. Then, although the means performed by the multithread 
can be considered, also in this case, a throughput does not go up by multithread control 
by the existing number of fixed threads depending on the situation of a receiving load, but 
the inconvenient problem that a useless thread exists and the whole processing engine 
performance falls arises in it. 

[0004] Moreover, since system (OS) processing intervened and the exchange of a message 
increased in the former also in queuing processing of the message which received through 
the communication line, there was a problem that the processing engine performance 
could not be improved to process at a high speed. 
[0005] 

[Problem(s) to be Solved by the Invention] Since reception of a message and processing 
according to the demand of a message which carried out the queuing were performing by 
one thread, respectively in the message receiving device in which processing which 
carried out the queuing of the processing demand message which received through the 
communication line conventionally, took out the message by which the queuing was 
carried out, and was demanded is performed as mentioned above, when the load was 
applied, the problem that where of a throughput will fall extremely was. Then, although 
the means performed by the multithread could be considered, also in this case, a 
throughput did not go up by multithread control by the existing number of fixed threads 
depending on the situation of a receiving load, but the inconvenient problem that a useless 
thread existed and the whole processing engine performance fell had arisen in it. 
Moreover, since system (OS) processing intervened and the exchange of a message 
increased in the former also in queuing processing of the message which received through 
the communication line, there was a problem that the processing engine performance 
could not be improved to process at a high speed. 

[0006] It aims at offering the multithread control system and the multithread control 
approach in the message receiving device in_which efficient multithread control can be 



performed in the message receiving device in_which processing which this invention was 
made in view of the above-mentioned actual condition, carried out the queuing of the 
processing demand message which received through the communication line, took out the 
message by which the queuing was carried out, and was demanded is performed. 
[0007] Moreover, this invention aims at offering the queuing method and the queuing 
approach in the message receiving device in which a queuing with the sufficient 
effectiveness by high-speed queue management can be performed in the message 
receiving device in which processing which carried out the queuing of the processing 
demand message which received through the communication line, took out the message 
by which the queuing was carried out, and was demanded is performed. 
[0008] 

[Means for Solving the Problem] This invention is characterized by carrying out adjustable 
control of the number of the threads which receive a message, and the number of the 
threads which process the message which carried out the queuing according to the 
receiving load profile initiation of a message in the message receiving device in which 
processing which carried out the queuing of the processing demand message which 
received through the communication line, took out the message by which the queuing was 
carried out, and was demanded is performed. 

[0009] Moreover, in queuing processing of the above-mentioned message receiving 
device, exclusion access by two or more threads is realized using a semaphore using a free 
queue and a YUZUDO queue, and it is characterized by carrying out adjustable control of 
the number of queues according to a load profile initiation. 

[0010] That is, in multithread control of the message receiving device in which processing 
which carried out the queuing of the processing demand message which received through 
the communication line, took out the message by which the queuing was carried out, and 
was demanded is performed, this invention investigates a message receive state with a 
predetermined time interval, and is characterized by always adjustable-control-controlling 
the number of message receiving threads to the proper number dynamically based on the 
condition. 

[0011] Furthermore, in multithread control of the above-mentioned message receiving 
device, this invention investigates the loaded condition of the message queue by which 
the queuing was carried out with the predetermined time interval, and is characterized by 
always adjustable-control-controlling the number of processing threads to the proper 
number based on the loaded condition. 

[0012] Furthermore, this invention is characterized by supervising the condition of a queue 
with a predetermined time interval, being in a setting range, increasing a queue, when the 
condition that queues are insufficient has been recognized, returning the number of 
queues to a initial value in multithread control of the above-mentioned message receiving 
device, when it has recognized that a queue is in a surplus condition, and always 
controlling the number of message queues to the proper number. 

[0013] By the above-mentioned multithread control, since it can process with the always 
proper number of threads, using a system resource efficiently, remarkable improvement in 
a system throughput and the processing engine performance can be aimed at, and an 
efficient message receiving device can be realized. 

[0014] Moreover, by the above-mentioned queuing control, in a message-processing 
device, an efficient queuing can be performed at high speed, and, thereby, remarkable 



improvement in a system throughput and the processing engine performance can be aimed 

at, using a system resource efficiently. 

[0015] 

[Embodiment of the Invention] With reference to a drawing, the operation gestalt of this 
invention is explained below. Drawing 1 is the block diagram showing the configuration 
of the whole system in 1 operation gestalt of this invention. 

[0016] Ten are a message receiving device by 1 operation gestalt of this invention among 
drawing, and L is a communication line. 11 thru/or 14 make the component of the 
message receiving device 10, respectively, and 1 1 is a message receiving thread device 
which sets the message which received the message on a communication line L and 
received by the multithread to the queue picked out from the free queue, and becomes by 
two or more message receiving thread (MRS) 11 1, 11 2, and - which realize a 
multithread. 

[0017] each of this message receiving thread (MRS) 1 1 - 1, 1 1 2, and - receive the 
processing demand message on a communication line L, respectively, load the queue 
which took out that message that received from free queue (FQ)12A with it, and perform 
reception of the message which sets that queue to YUZUDO (queue UQ) 12B. 
[0018] Here, adjustable control is carried out under control of message receiving thread 
(MRS) 1 1 1 in this message receiving thread device 11,112, and the thread queue control 
mechanism (SAQM) 14 of - that a number mentions later. 

[0019] 12 is a message queue for receiving and processing a message, and becomes by 
free queue (FQ)12A for stacking the message which received, and YUZUDO (queue UQ) 
12B loaded with the message which received. Here, it releases, after processing the queue 
taken out from YUZUDO (queue UQ) 12B, and it returns to free queue (FQ)12A, a queue 
is reused, and it has the structure where memory is not consumed too much. 
[0020] Moreover, adjustable control is carried out here under the control of the thread 
queue control mechanism (SAQM) 14 which the number of the queue put on free queue 
(FQ)12A of a message queue 1 2 mentions later. 

[0021] 13 takes out the queue with which YUZUDO (queue UQ) 12B was loaded, is the 
message-processing thread device in which processing according to the demand of the 
message set to the queue is performed, and becomes by two or more message-processing 
thread (PES) 13 1, 13 2, and - which realize a multithread. 

[0022] this » each - message-processing thread (PES) 13 1 , 1 3 2, and - take out the queue 
with which YUZUDO (queue UQ) 12B was loaded, respectively, perform processing 
according to the demand of the message set to that queue, release a queue, and return it to 
free queue (FQ)12A. 

[0023] Here, adjustable control is carried out under control of message-processing thread 
(PES) 13 1 in this message-processing thread device 13, 13 2, and the thread queue control 
mechanism (SAQM) 14 of - that a number mentions later. Moreover, exclusive control 
between each thread is performed by the semaphore. 

[0024] 14 recognizes the receiving loaded condition of each processing section, and has a 
function manager as is the thread queue control mechanism (SAQM) which is in a setting 
range and carries out adjustable control and shows each above-mentioned thread and a 
queue to drawing 5 here according to the loaded condition. 

[0025] Drawing 2 thru/or drawing 4 are each flow chart of the message reception in the 
above-mentioned operation gestalt, a queuing, and message processing, respectively, it 



shows the Maine processing flow to drawing 2 , shows a message reception flow to 
drawing 3 , and shows the processing flow (message-processing flow) of a queue to 
drawing 4 . 

[0026] In the processing of step A3 shown in drawing 2 , since message reception is slow 
when there are many free queues, it becomes the guide which increases a receiving 
thread. Moreover, since processing is slow when there are many YUZUDO queues, it 
becomes the guide which increases a processing thread. Moreover, when the big speed 
difference is in a receiving thread and a processing thread, it becomes the guide which 
makes the number of queues fluctuate. 

[0027] In the processing of step B-2 shown in drawing 3 , and processing of step C1 shown 
in drawing 4 , since exclusion is carried out by the semaphore, access of a queue is kept 
waiting, while other threads access. 

[0028] Drawing 5 is performed by the above-mentioned thread queue control mechanism 
(SAQM) 14. It is the flow chart which shows a thread and the adjustable control procedure 
of a queue. Message receiving thread (MRS) 111,112,- and message-processing thread 
(PES) 13 1,13 2, and -, Free queue (FQ) The number of each of a message queue 12 
which becomes by 12A and YUZUDO (queue UQ) 12B is controlled by the always proper 
value according to loaded condition within limits set up beforehand, respectively. 
[0029] Here explains the actuation in the operation gestalt of this invention with reference 
to each above-mentioned drawing. Drawing 2 is referred to first and the Maine processing 
at the time of program starting is explained. In this Maine processing, initialization of a 
queue is performed first and the queue of the initialization number defined beforehand is 
put on free queue (FQ)1 2A ( drawing 2 step A1). 

[0030] Moreover, message receiving thread (MRS) 1 1 1 of the convention number 
beforehand set to the message receiving thread device 11, 11 2, and - are generated, and 
message-processing thread (PES) 1 3 1 of the convention number similarly further set to the 
message-processing thread device 13 beforehand, 13 2, and - are generated ( drawing 2 
step A2). 

[0031] Then, reception is started, message reception shown in drawing 3 and message 
processing accompanying processing of the queue shown in drawing 4 are performed, and 
it is controlled by the proper number in each of that processing process within limits as 
which adjustable control of each thread and a queue was performed, and each thread and 
a queue were beforehand determined to the bottom of control of the thread queue control 
mechanism (SAQM) 14 according to loaded condition, respectively. 
[0032] Under the present circumstances, the number of message receiving thread (MRS) 1 1 
1, 11 2, and - is adjusted, such as increasing the number of receiving threads and 
gathering receiving speed from a receive state, the loaded condition of a message, etc. as 
receiving thread control, in order to raise a throughput when processing of a processing 
thread is quick. 

[0033] Moreover, when a difference is in the speed of reception and processing as queue 
control, the queue in a message queue 12 collecting and looking at condition, the number 
of queues of a message queue 12 is made to fluctuate, and the number of queues is 
adjusted to a proper value. 

[0034] About adjustable control processing of each above-mentioned thread by the thread 
queue control mechanism (SAQM) 14 in this case and a queue, it mentions later with 
reference to drawing 5 . In message reception, message receiving thread (MRS) 11 1,11 2, 



and - receive a message, respectively, and set to the queue of a message queue 12 (the 
drawing 3 step B1 and B-2). As processing of the queue in this case, one queue is first 
taken out from free queue (FQ)12A, a message is set to that queue, and actuation of 
putting that queue on YUZUDO (queue UQ) 12B is performed. These processings of a 
series of are performed by the semaphore by exclusive control under a multithread 
environment. 

[0035] Message-processing thread (PES) 13 1,13 2, and - take out a message from the 
queue with which YUZUDO (queue UQ) 12B was loaded, and perform processing 
according to expectation of the message (the drawing 4 step C1 and C2). As processing of 
the queue in this case, one queue is first taken out from YUZUDO (queue UQ) 12B, a 
message is processed, and actuation which sets that queue to free queue (FQ)12A is 
performed. These processings of a series of are performed by the semaphore by exclusive 
control under a multithread environment. 

[0036] It consists of free queue (FQ)12A and YUZUDO (queue UQ) 12B, a message queue 
12 connects a chain, changes a fixed number of queues, and as it is reused, it is using it. 
[0037] If a queue exists in free queue (FQ)12A, message receiving thread (MRS) 1 1 1 of the 
message receiving thread device 11, 11 2, and - gain the queue, and lock subsequent 
queue actuation. This lock locks access to the queue of the both sides of a receiving thread 
and a processing thread. 

[0038] If a processing thread has a YUZUDO queue, it will gain it, and as it locks the 
queue actuation after it, it is controlling it. The lock to this queue actuation locks access of 
the thread of other reception and the both sides of processing. Under the present 
circumstances, it is kept waiting until a lock will be canceled, if other threads lock and it 
becomes during actuation. 

[0039] Here, adjustable control processing of each above-mentioned thread and a queue is 
explained with reference to drawing 5 . The thread queue control mechanism (SAQM) 14 
recognizes the condition of the load of each part with a fixed time interval, carries out 
adjustable control within limits which were able to define each thread and a queue 
beforehand according to each of that loaded condition, and it is controlled so that each 
thread and a queue become an always proper number within limits defined beforehand, 
respectively. 

[0040] That is, the thread queue control mechanism (SAQM) 14 checks the condition of 
reception and a queue at fixed spacing in receiving thread control ( drawing 5 step S1). 
Here, when YUZUDO (queue UQ) 12B judges that it is extremely small (there are few 
queues), receiving spacing of a message is checked at or when [ when it judges that 
receiving spacing of a message is long, or when it judges that reception is late ] ( drawing 5 
stepS11). 

[0041] When receiving spacing of a message judges that it is shorter than criteria spacing 
set up beforehand with this check If it is message receiving thread (MRS) 1 1 1 put on the 
message receiving thread device 11, 11 2, and less than the upper limit of - that checked 
the number ( drawing 5 step S12), and was defined beforehand It judges that reception is 
late, a message receiving thread is newly generated, and the number of message receiving 
thread (MRS) 111,112, and - put on the message receiving thread device 1 1 is increased 
( drawing 5 step S1 3). 

[0042] Moreover, with the check ( drawing 5 step S1 1) of the above-mentioned message 
receiving spacing, when it is more than criteria spacing to which receiving spacing of a 



message was set beforehand It is judged that it is in the condition that the message is not 
coming frequently. Message receiving thread (MRS) 1 1 1, 1 1 2, -, The numbers of each, 
such as message-processing thread (PES) 13 1, 13 2, -, free queue (FQ)12A, are 
investigated, and only fixed numbers reduce the number to the thread more than the 
number of conventions, a queue, etc. ( drawing 5 step S1 4). 

[0043] Thus, adjustable control of the number is carried out within the limits of [ which 
was able to be defined beforehand ] message receiving thread (MRS) 1 1 1 put on the 
message receiving thread device 11, 11 2, and and it controls to become an always 
proper number within limits as which message receiving thread (MRS) 111,112, and - 
were determined beforehand. 

[0044] Moreover, the thread queue control mechanism (SAQM) 14 checks the condition of 
a queue at fixed spacing in processing thread control ( drawing 5 step S1). Here, when 
YUZUDO (queue UQ) 12B judges that it is extremely large (there are many queues), the 
number of message-processing thread (PES) 13 1, 13 2, and - put on the message- 
processing thread device 1 3 is checked ( drawing 5 step S21). 

[0045] Under the present circumstances, if it is message-processing thread (PES) 13 1 put 
on the message-processing thread device 13, 13 2, and less than the upper limit of - as 
which the number was determined beforehand, a message-processing thread will newly be 
generated and the number of message-processing thread (PES) 13 1,13 2, and - put on the 
message-processing thread device 1 3 will be increased ( drawing 5 step S22). 
[0046] Moreover, when it is message-processing thread (PES) 13 1 put on the message- 
processing thread device 13, 13 2, and more than criteria spacing of - to which the 
number was set beforehand When it judges that the condition of a message queue 12 is 
investigated ( drawing 5 step S23), and queues are insufficient Furthermore, the number of 
free queue (FQ)12A is investigated ( drawing 5 step S24), and if it is less than the upper 
limit as which the number of the queues was determined beforehand, only fixed numbers 
will increase the number of queues ( drawing 5 step S25). 

[0047] Thus, adjustable control is carried out within limits which were able to define 
beforehand the number and the number of the queues put on a message queue 12 of 
message-processing thread (PES) 13 1 put on the message-processing thread device 13, 13 
2, and respectively, and it controls to become an always proper number within limits 
defined beforehand. 

[0048] Moreover, in the status check ( drawing 5 step S1) of a queue, when it judges that it 
is in the condition that there is no load, the number of each above-mentioned thread and 
queues is returned to the condition at the time of initialization ( drawing 5 step S31). 
[0049] Moreover, in the status check ( drawing 5 step S1) of the above-mentioned queue, 
when it judges that the condition of a proper queue is maintained, adjustable control of a 
thread and a queue is not performed, but the present condition is maintained. 
[0050] It described above, and by multithread control which was carried out, since it can 
process with the always proper number of threads, using a system resource efficiently, 
remarkable improvement in a system throughput and the processing engine performance 
can be aimed at, and an efficient message receiving device can be realized. 
[0051] Moreover, by queuing control which was described above, in a message-processing 
device, an efficient queuing can be performed at high speed, and, thereby, remarkable 
improvement in a system throughput and the processing engine performance can be aimed 
at, using a system resource efficiently. 



[0052] An efficient processing system is realizable by applying to a system which receives 
many messages and processes the above-mentioned operation gestalt in a server machine 
etc. 
[0053] 

[Effect of the Invention] As a full account was given above, according to this invention, the 
queuing of the processing demand message which received through the communication 
line is carried out. The number of the threads which receive a message in the message 
receiving device in which processing which took out the message by which the queuing 
was carried out and was demanded is performed, By having had the function which carries 
out adjustable control of the number of the threads which process the message which 
carried out the queuing according to the receiving load profile initiation of a message 
Since it can process with the always proper number of threads, using a system resource 
efficiently, remarkable improvement in a system throughput and the processing engine 
performance can be aimed at, and an efficient message receiving device can be realized. 
[0054] Moreover, when the condition that according to this invention supervise the 
condition of a queue and queues are insufficient with a predetermined time interval in 
multithread control of the above-mentioned message receiving device has been 
recognized, When it has recognized that it is in a setting range, a queue is increased, and a 
queue is in a surplus condition, By having returned the number of queues to the initial 
value, and having had the function to always control the number of message queues to the 
proper number An efficient queuing can be performed at high speed and, thereby, 
remarkable improvement in a system throughput and the processing engine performance 
can be aimed at, using a system resource efficiently. 



[Claim(s)] 

[Claim 1] The multithread control approach in the message receiving device characterized 
by to investigate a message receive state with a predetermined time interval, and to always 
adjustable-control-control the number of message receiving threads to the proper number 
dynamically based on the condition in multithread control of the message receiving device 
in which processing which carried out the queuing of the processing demand message 
which received through the communication line, took out the message by which the 
queuing was carried out, and was demanded is performed. 

[Claim 2] In the multithread controlling mechanism of the message receiving device in 
which processing which carried out the queuing of the processing demand message which 
received through the communication line, took out the message by which the queuing was 
carried out, and was demanded is performed A means to generate the message receiving 
thread for carrying out reception of the message, and a means to manage the number of 
the thread concerned, A means to recognize the receive state or reception condition of a 
message of a message by which the queuing was carried out with the predetermined time 
interval with a predetermined time interval, The means which is in a setting range and 
carries out adjustable control of the number of message receiving threads dynamically 
according to the receive state or reception condition of a message is provided. The 
multithread control system in the message receiving device characterized by controlling 
the number of message receiving threads to the always proper number according to the 
receive state or reception condition of a message. 



[Claim 3] The reception means of the message which carries out the queuing of the 
processing demand message which received through the communication line, And it sets 
to multithread control of the message receiving device in which it comes to have the 
processing activation means of the message by two or more processing threads which 
perform processing which took out the message by which the queuing was carried out and 
was demanded. The multithread control approach in the message receiving device 
characterized by investigating the loaded condition of the message queue by which the 
queuing was carried out with the predetermined time interval, and always adjustable- 
control-controlling the number of processing threads to the proper number based on the 
loaded condition. 

[Claim 4] In the multithread controlling mechanism of the message receiving device in 
which processing which carried out the queuing of the processing demand message which 
received through the communication line, took out the message by which the queuing was 
carried out by the processing thread, and was demanded is performed A means to generate 
the processing thread for performing processing which took out the message by which the 
queuing was carried out and was demanded, and a means to manage the number of the 
thread concerned, A means to recognize the loaded condition of the message by which 
the queuing was carried out with the predetermined time interval, The means which 
carries out adjustable control of the number of processing threads dynamically according 
to the loaded condition of a message is provided. The multithread control system in the 
message receiving device characterized by controlling the number of processing threads to 
the always proper number according to the loaded condition of the message by which the 
queuing was carried out. 

[Claim 5] The queuing of the processing demand message which received through the 
communication line is carried out to a queue. When the condition that supervise the 
condition of a queue and queues are insufficient with a predetermined time interval in the 
message receiving device in which processing which took out the message by which the 
queuing was carried out and was demanded is performed has been recognized, The 
queuing approach in the message receiving device characterized by being in a setting 
range, increasing a queue, returning the number of queues to a initial value when it has 
recognized that a queue is in a surplus condition, and always controlling the number of 
message queues to the proper number. 

[Claim 6] The queuing of the processing demand message which received through the 
communication line is carried out to a queue. A means to supervise the condition of a 
queue with a predetermined time interval, and to recognize the excess and deficiency of a 
queue in the message receiving device in which processing which took out the message by 
which the queuing was carried out by the processing thread, and was demanded is 
performed, When the insufficient condition of a queue has been recognized and the 
surplus condition of a queue has been recognized to be a means to be in a setting range 
and to increase a queue, The queuing method in the message receiving device 
characterized by providing a means to return the number of queues to the initialization 
number, being in a setting range and controlling the number of queues to an always 
proper value according to the reception condition of a message. 

[Claim 7] The multithread control system in the according to claim 2 or 4 adjustable 
control message [ manage a queue at a free queue and a YUZUDO queue, and / number / 
of threads ] receiving device based on the condition of a YUZUDO queue. 



